Memorization of Melodies by Complex-valued Recurrent Network
نویسندگان
چکیده
Memorization of the temporal sequences is very important and interesting problem. One of the examples is memorization of melodies. When we memorize melodies, we can recall it from a part. The function can be considered as an associative memory of the temporal sequences. From a technical point of view, it can be considered that the rest of the melody can be determined by some leading some notes. In this paper, we apply the complex-valued recurrent network, which has much superior ability to deal with temporal sequences than the conventional real-valued networks, to memorization of melodies. It is shown in computer simulations that the network can memorize some melodies and recall them correctly from any part.
منابع مشابه
Associative Long Short-Term Memory
We investigate a new method to augment recurrent neural networks with extra memory without increasing the number of network parameters. The system has an associative memory based on complex-valued vectors and is closely related to Holographic Reduced Representations and Long Short-Term Memory networks. Holographic Reduced Representations have limited capacity: as they store more information, ea...
متن کاملPrototypical Recurrent Unit
The difficulty in analyzing LSTM-like recurrent neural networks lies in the complex structure of the recurrent unit, which induces highly complex nonlinear dynamics. In this paper, we design a new simple recurrent unit, which we call Prototypical Recurrent Unit (PRU). We verify experimentally that PRU performs comparably to LSTM and GRU. This potentially enables PRU to be a prototypical example...
متن کاملComplex Valued Recurrent Neural Network: From Architecture to Training
Recurrent Neural Networks were invented a long time ago, and dozens of different architectures have been published. In this paper we generalize recurrent architectures to a state space model, and we also generalize the numbers the network can process to the complex domain. We show how to train the recurrent network in the complex valued case, and we present the theorems and procedures to make t...
متن کاملJazz Melody Generation from Recurrent Network Learning of Several Human Melodies
Recurrent (neural) networks have been deployed as models for learning musical processes, by computational scientists who study processes such as dynamic systems. Over time, more intricate music has been learned as the state of the art in recurrent networks improves. One particular recurrent network, the Long Short-Term Memory (LSTM) network shows promise as a module that can learn long songs, a...
متن کاملHistorical Consistent Complex Valued Recurrent Neural Network
Recurrent Neural Networks are in the scope of the machine learning community for many years. In the current paper we discuss the Historical Consistent Recurrent Neural Network and its extension to the complex valued case. We give some insights into complex valued back propagation and its application to the complex valued recurrent neural network training. Finally we present the results for the ...
متن کامل